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Abstract. K. Grove, L. Verdiani, B. Wilking and W. Ziller gave the first examples of co- 
homogeneity one manifolds which do not carry invariant metrics with non-negative sectional 
curvatures. In this paper we generalize their results to a larger family. We also classified 
all class one representations for a pair (G,H) with G/H some sphere, which are used to 
construct the examples. 

1. Introduction 

Non-negatively curved Riemannian manifolds have been of interest from the beginning 
of global Riemannian geometry. Most examples are obtained via product and quotient 
constructions, starting from compact Lie groups. These include all homogeneous spaces and 
biquotients. Using a gluing method, J.Cheeger constructed non-negatively curved metrics on 
the connect sum of any two rank one symmetric spaces, see |Ch] . A breakthrough came with 
K. Grove and W. Ziller 's generalization of this gluing method to the class of cohomogeneity 
one manifolds. 

A manifold M is called a cohomogeneity one manifold if there exists a compact Lie group 
G acting on M by isometries and the cohomogeneity of the action, defined as cohom(M, G) = 
dim(M/G), is equal to 1. Since the orbit space is one dimensional, it is either a circle or a 
closed interval /. In the former case, M always carries a G invariant metric with non-negative 
sectional curvature. In the latter one, there are precisely two singular orbits B± with isotropy 
subgroups K ± corresponding to the endpoints of /, a minimal geodesic between the singular 
orbits, and principal orbits corresponding to the interior points with isotropy subgroup H. 
By the slice theorem, K ± /H are spheres S' ±_1 (l± > 1), and M can be reconstructed by 
gluing two disk bundles along a principal orbit as follows 

(1.1) M = G x K -B l - U G/H G x K+ B l+ , 

where 3 l± is the normal disk to B±. Therefore we can identify M with the groups H C 
{K~, K + } C G by the gluing construction (II. ip . 

K. Grove and W. Ziller showed that any cohomogeneity one manifold with codimension 



two singular orbits admits a non-negatively curved metric |GZ1] . In the same paper, it was 
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conjectured that any cohomogeneity one manifold admits a non-negatively curved metric. 
This turns out to be false. The first examples of an obstruction were discovered by K. Grove, 
L.Verdiani, B.Wilking and W.Ziller in |GVWZ] . The most interesting examples are the 
higher dimensional Kervaire spheres (of dimension 9 and up) which are the only exotic 
spheres that can carry a cohomogeneity one action, see [St] . 

In light of the construction of examples with non-negative sectional curvature and the 
examples of obstructions to non-negatively curved metrics, it is important to answer the 
question "How large is the class of cohomogeneity one manifolds that admit a non-negatively 
curved metric?" which was raised by W.Ziller in [ZiJ. 

In this paper, we generalize the examples in [GVW Zj to a larger family: 

Theorem. Let K' / H' = E> k with k > 2 and p : K' — > SO(m) be a faithful irreducible 
representation, which is not the one of K' on M, k+1 , and such that p(H') C SO(m — 1). For 
any integer n > m + 2, set G = SO(n) and 

K~ = p(K') x SO(n - m) C SO{m) x SO(n - m) C SO{n) 
K + = p(H') x SO{n-m + 1) C SO(m - 1) x SO(n-m + 1) C SO(n) 
H = p(H') x SO(n - m) C SO(n), 

then the cohomogeneity one manifold M defined by the groups H C {K~, K + } C G does not 
admit a G invariant metric with non-negative sectional curvature. 

In [GVWZj . the theorem was proved under the additional assumptions that the slice 
representation of K' is not contained in the symmetric square Sym 2 p and p(K') does not act 
transitively on the sphere S m_1 = SO(m)/ SO(m — 1). 

This theorem is optimal in the sense that if p is the representation of K' on then the 

manifold M does admit an invariant non-negatively curved metric, since it is diffeomorphic to 
the homogeneous space SO(n+l)/ (p(K') x SO(n — m+1)) endowed with the cohomogeneity 
one action of SO(n) C SO(n + l). On the other hand, if n = m + 1 one obtains an interesting 
cohomogeneity one manifold where it is not yet known wether that manifold carries a non- 
negatively curved invariant metric or not. 

The theorem can be extended to the case where p is not necessarily irreducible, see The- 
orem [37TJ A representation p : K' — > SO(m) with p(H') C SO(m — 1) is called a class one 
representation, see Definition 12. 71 Many class one representations are not faithful, see Propo- 
sition [AJJ3 and Table [2} so they are excluded by the faithfulness requirement in [GVW Zj. 
However Theorem 13.11 allows non-faithful class one representation as a subrepresentation of 
p and it gives us many more examples, see Section [3j 



NEW EXAMPLES OF OBSTRUCTIONS 



3 



Similar results also hold if p is a complex or quaternionic representation, i.e., G = U(n) 
or Sp(n) which are stated in the Theorem 16.11 and Theorem 16.61 

In the above theorem, Theorem 13 .![ Theorem 16.11 and Theorem 16.61 the group K' does not 
need to be connected. But the corresponding groups K ± on the universal cover M will be 
connected. Therefore in the rest of the paper, we can assume that all groups are connected. 

The paper is organized as follows. In Section [21 we briefly recall basic properties of 
cohomogeneity one manifolds, the generalized Weyl group and metric properties. Also this 
section includes an introduction to class one representations. A more detailed discussion of 
such representations is given in Appendix |A] In Section [3] we prove some basic properties 
of the new examples which will be used in the proof of the orthogonal case. In Section 
IH we study the consequences of the non-negativity assumption on the metrics. Wilking's 
rigidity theorem for non-negatively curved manifolds [Wil] plays an important role. Section 
|5] is devoted to the proof in the orthogonal case. Using properties of the metrics developed 
in the previous sections, we draw a contradiction by looking at sectional curvatures of 2 
distinct classes of 2-planes. In the last section, we sketch an outline of the proofs in the case 
where G = U(n) or Sp(n). 

Acknowledgements: The paper is part of the author's Ph.D. thesis at University of Penn- 
sylvania. The author wants to thank his advisor, Prof. Wolfgang Ziller, for his generous 
supports and great patience, and to Prof. Kristopher Tapp for valuable discussions on Wilk- 
ing's rigidity results. 



2. Preliminaries 

In this section, we recall some basic and well-known facts about cohomogeneity one man- 
ifolds. For more detail, we refer to, for example, [AA] and [GWZ] . 

As mentioned already, there are precisely two non-principal orbits B± in a simply con- 
nected cohomogeneity one manifold. Suppose M is endowed with an invariant metric g and 
the distance between the two non-principal orbits is L. Let c(t), t G R be a geodesic mini- 
mizing the distance with c(0) = p_ G B- and c(L) = p + G B + . The isotropy subgroups at 
p± are denoted by K ± and the principal isotropy subgroup at any point c(t), t G (0, L), is 
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denoted by H. We can draw the following group diagram for the manifold M: 



G 



K 




K+ 



H 



The group diagram H C {K~,K + } C G is not uniquely determined by the manifold since 
one can switch K~ with K + , change g to another invariant metric and choose another 
minimal geodesic c(t). 

Definition 2.1. Two group diagrams are called equivalent if they determine the same co- 
homogeneity one manifold up to equivariant diffeomorphism. 

The following lemma characterizes which two group diagrams are equivalent, see in [GWZ] . 



Lemma 2.2. Two group diagrams H C {K~ , K + } C G and H C C G are 

equivalent if and only if after possibly switching the roles of and K + , the following holds: 
There exist elements b 6 G and a e N(H) , where N(H) is the identity component of the 



Remark 2.3. If c(t) is the minimal normal geodesic between the two singular orbits, then 
b~kc(t) is another minimal geodesic between B± and the associated group diagram is obtained 
by conjugating all isotropy groups by the element b. We can assume that b e N(H)f]N(K~) 
in order to fix H and K~ . Conjugation by an element a as in the above lemma usually 
corresponds to changing the invariant metric on the manifold. 

Let C C M be the image of the minimal geodesic c(t). Then the Weyl group W of the 
G— action on M is by definition the stablizer of C modulo its kernel H . W is characterized 
in the following proposition. 

Proposition 2.4. The Weyl group W of a cohomogeneity one manifold is a dihedral subgroup 
ofN(H)/H. It is generated by involutions w± G (N^nK^/H andC/W = M/G = [0,L]. 
Each of these involutions can be represented as an element a e K ± H H such that a 2 but not 
a lies in H. 

Using the group action, the invariant metric is determined by its restriction to the minimal 
geodesic c(t). Suppose c(t) is parameterized by arc length, i.e., T = 4 has length 1, then 




normalizer of H , with K 



bK~b~ x , H = bHb-\ and K + = abK+b^a 



-l 
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we can write g as 

g = dt 2 + g t , 

and {gt} t e[0L] * s a one-parameter family of homogeneous metrics on the orbits M t = G.c(t). 

Fix a bi-invariant inner product Q on the Lie algebra g of G and let p = f) -1 be the 
orthogonal complement of the Lie algebra f) of H . For each X e p, let X* be the Killing 
vector field generated by X along c(i), i.e.,X*(t) = ^| s=0 exp(sX).c(t). For each t e (0,L), 
M t is diffeomorphic to the homogeneous space G/H, and hence T c (t)M t can be identified 
with p by means of Killing vector fields asln X*(t). Then ^ defines an inner product on 
p which is invariant under the isotropy action of Ad#. We set 

(2.5) g t (X, Y) = g t {X*(t), Y*(t)) = Q(P t X, Y) for X, Y e p, 

where P t : p — > p is a Q-symmetric Ad#-equivariant endomorphism. The metric g is 
completely determined by the one parameter family {Pt}, t G [0, L], and at t = and L, P t 
should satisfy further conditions to guarantee smoothness of g. 

On the other hand, each principal orbit M t is a hypersurface in M with normal vector T. 
If S t X = S t X*(t) = — Vx*T is the shape operator of M t at c(t), we have 

(2-6) St = -\Pr l Pl 

in terms of P. 

In the rest of this section, we give a short introduction to class one representations with 
more details in Appendix [A] This particular class of representations is well studied, see, for 
examples, [VK] and |Waj . 

First we recall: 

Definition 2.7. A representation (/x, W) of a compact Lie group K is called a real (complex 
or quaternionic ) representation if W is a vector space over R (C or H) . 

Definition 2.8. Suppose is an irreducible representation over the complex numbers, then 
W is called a real representation or of real type if it comes from a representation over reals 
by extension of scalars. It is of quaternionic type if it comes from a representation over 
quaternions by restriction of scalars. It is of complex type if it is neither real or quaternionic. 

For any complex representation /i, let fi* denote its complex conjugate, /x* is equivalent 
to fi if /x is of type real or quaternionic and they are non-equivalent if /x is of complex type. 

Suppose K is a compact connected Lie group, then the complexification of a real irreducible 
representation a is one of the following 

(1) <7c = /x, where /x is an irreducible representation of real type, 
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(2) ere = /i © /!*, where « is irreducible and of complex type, 

(3) 0c = « © /i, where /i is irreducible and of quaternionic type. 

In class (EJ) and ([3]), we often write a = 

Conversely, suppose /z is a complex irreducible representation of K with degree n. If fi is 
of real type, then there exists a real vector space M n C C n which is yu(.K') invariant. Let a 
be the restriction of /i on l n , then a is a real irreducible representation with ac = /-!>■ If H is 
not of real type, then we identify C n with M. 2n and forget the complex structure on it. Thus 
M 2n is invariant under the n{K) action and it gives us a real irreducible representation. We 
denote this representation by a and then <7 C is either fi © «* or « © « depending on the type 
of \i. 

A quaternionic irreducible representation is obtained by extending the scalar field to the 
quaternions for a complex irreducible representation and the converse also holds. 

Given an n dimensional real irreducible representation (a, W) of a compact Lie group K, 
we briefly discuss the classification of the equivariant endomorphisms, i.e., the endomorphism 
/ : W — > W with f(a(g).v) = a(g).f(v) for any g G K and v G W. 

If a is in class (1), then from Schur's lemma, / = aid for some constant a G ffi. and Id is 
the identity map of W . 

If a is in class (2), then W has an orthonormal basis such that / is in the following form 
under that basis 



where do, cl\ are constants in R, n = 2m and I m is the m x m identity matrix. 

If a is in class (3), then there exists an orthonormal basis of W such that / has the 
following form under that basis 



where n = 4m, ao, ai, &2 and 03 are constants in R. 

Definition 2.11. A pair (K, H) of compact Lie groups with H C K and K/H = E k (k > 2) 
is called a spherical pair. 



(2.9) 




(2.10) 



./ 




If we assume that K is connected, the image of ji will be a closed subgroup of SO(l), U{1) 
or Sp(l) if n is over R, C or EL 
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For each group pair (K, H) with H C K a closed subgroup, we have 

Definition 2.12. A non-trivial irreducible representation (fi,W) of K is called a class one 
representation of the pair (K, H) if fi(H) fixes a nonzero vector wq G PF. 

Remark 2.13. From Proposition IA.191 the class one representations of spherical pairs are 
almost effective, i.e., the kernel of /z is discrete, except for the following cases: 

(1) (K,H) = (U(n),U(n — l) m ) and /i = ae\ — ae n where a is a positive integer. The 
kernel is the diagonal embedded U(l) C U(n). 

(2) (Sp(n) x Sp(l), Sp{n — 1) x Sp{l)) and /i = aw2 where a is a positive integer. The 
kernel contains the Sp(l) factor. 

(3) (Sp(n) x U(l), Spin — 1) x U{l) m ) and /i = (oci + fcc^) <8> id where a, 6 are non- 
negative integers with a + b > 1 and id is the trivial representation of U(l). The 
kernel contains the U(l) factor. 

More information on the non-trivial kernels for class one representations is given in Propo- 
sition IA.191 and listed in Table [2j 

In the case where (K,H) = (SO(k + l),SO(k)), let w\ be the highest weight of the 
standard representation Qk + i on R fc+1 , then the class one representations over M. are precisely 
those with the highest weights as mw\, m = 1,2, . . .. These representation spaces can be 
realized as the space of homogeneous harmonic polynomials. Let {x±, . . . ,Xk+i} be the 
basis of IR fc+1 and SO(k + 1) act by the matrix multiplication. Then an element A 6 
SO(k + 1) acts on a polynomial f(x\, . . . ,£fc+i) through the action on the variables, i.e., 
(A/)(£i, . . . , x k+ i) = f{A~ l .x u A _1 .x fe+ i). 

A polynomial / is called harmonic if Af = where A = Yli=i JT- Let H m be the space 

i 

of homogeneous harmonic polynomials in x\, . . . ,Xk+i of degree m, then the representation 
of SO(k + 1) on H m has the highest weight mw\. All of them are of real type. If k + 1 
is odd, then the representation for any positive m is faithful. If k + 1 is even, then the 
class one representation is faithful if and only if m is odd. As we will see that the class one 
representations of other spherical pairs (K, H) are the irreducible components when H m is 
restricted to the subgroup K of SO(k + 1). 

The real, complex and quaternionic class one representations of the spherical pairs are 
classified in Appendix [A] Further properties are discussed there as well. 

3. Weyl group and smoothness 

First let us state the most general result in the orthogonal generalization of the 

theorem in the introduction using the concept of class one representation: 
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Theorem 3.1. Let K'/H' = § fe with k > 2 and p : K' — ► SO(m) be a faithful represen- 
tation that contains a (not necessarily faithful) irreducible class one representation p of the 
pair (K', H') such that one of the followings holds: 

(1) deg p > k + 2 if p is of real type or the multiplicity of p in p, denoted by mvl(p, p), 
is equal to 1; 

(2) deg p > 2{k + 2) if p is of complex type and mul(/i, p) > 2; 

(3) deg/i > 4(fc + 2) if p is of quaternionic type and mul(/i, p) > 2. 

We assume that n > m + 2 z/ mul(/j, p) = 1, and that n > m + 3 if mul(/j, p) > 2. // we 
sei G = SO{n) and 

K~ = p(K') x SO(n - m) c S'O(m) x 50(n - to) C S'O(n) 
(3.2) = p(ff') x £0(71-771 + 1) C SO(m-l) x SO(n-m + l) c 50(n) 

£T = p(^') x 50(77 - m) c S'O(n), 

then the cohomogeneity one manifold M defined by the groups H C C G does not 

admit a G invariant metric with non-negative sectional curvature. 

Remark 3.3. Since we do not assume that p is faithful, a non-faithful class one representation 
is allowed in this construction. In other words, if p is a class one representation with 
deg p > k + 2, we choose a representation r with kerr fl ker/i = {1}. Then p = r © p 
satisfies the conditions in the theorem. For example, take (K',H') = (S0(6), 50(5)) with 
k = 5 and let p be the 20 dimensional representation of SO (6) with the highest weight 
2tn\. To construct a cohomogeneity one manifold, we can choose r = g e as the standard 
representation of 50(6) which is faithful and let p = r © p. 

Remark 3.4. If p contains only one copy of p or p is of real type, then Table [3] in Proposition 
IA.21I lists all real class one representations which have dimensions smaller than k + 2. We 
see that only the following representations are excluded by the assumption, deg p > k + 2: 
the defining representation of K' on the 9 dimensional representation g$ of the pair 

(Spin(9), Spin(7)), the 5 dimensional representation of (Sp(2), Sp(l)) and the 3 dimensional 
representations of (SU(2), {Id}) and (U(2), U(l)). All of these representations are not faith- 
ful, so one needs to add another representation r with kerr fl ker/i = {Id} to define a 
cohomogeneity one manifold. For such manifolds, we do not know if they admit an invariant 
metric with non-negative curvature. 

Remark 3.5. If p contains more than one copy of p and p is not of real type, then the further 
restriction degp > 2(k + 2) or 4(k + 2) excludes 8 more representations as listed in the 
last part of Table [3j Among them, the following representations are faithful: p = [2tui] K 



NEW EXAMPLES OF OBSTRUCTIONS 



9 



for the pair (577(3), 577(2)), p = [vji + g72]r for the pair (Sp(2), Sp(l)) and p = [3wi]m., 
[&&i]m an d [7^i]r for the pair (5p(l), {1})- The first one is of complex type and the other 
four are of quaternionic type. They can be used to construct cohomogeneity one manifolds 
without adding other representations, for example, take (K',H') = (Sp(l), {1}) and p = 
[3z*7i]r © [3g7i]r. Thus Theorem 13.11 does not give obstruction for such manifolds. 

Remark 3.6. The lowest dimensional example of Theorem 13.11 is obtained as follows. Take 
(K',H') = (50(3), 50(2)) with K'/H' = S 2 , then the lowest dimensional class one repre- 
sentation p with deg > 3 is the unique 5— dimensional representation of 50(3) which is also 
faithful. If m = 5 and n = 7, the manifold M has dimension 20 and isotropy groups 

p{SO{2)) x 50(2) c 0450(3)) x 50(2), p(SO(2)) x 50(3)} c 50(7). 

Notice that this example is already covered by Theorem 3.2 in [GVW Zj. 

We now describe the explicit embedding of the groups. 50 (m) x SO(n — m) is embedded 
in G = SO(n) block- wise, i.e., 50 (m) sits in the upper-left m x m-block and SO(n — m) 
is in the lower-right block. By assumption, p is a faithful orthogonal representation of K' 
with representation space V = M. m . Let Wi, . . . , W a be invariant subspaces of V such that 
they are pairwisely orthogonal, and the restrictions of p(K')\ w . = p are equivalent and 
irreducible. Let U be the orthogonal complement of W = W\ @ ■ ■ ■ ® W a . According to the 
decomposition of V into invariant spaces, we can write p as 

(3.7) p = r®p®---®p, 

where r is restriction of p to U and p is the class one representation of (K', H'). Furthermore, 
p is not a subrepresentation of r. Suppose r = dim U, I = dim Wi = deg p, then m = r + al. 
By choosing a suitable basis of V, p(x) for i e is a block diagonal matrix in 50 (m): 

(t{x) \ 



(3.8) p{x) 



p(x) 



e 50(r) x SO (I) x •■■ x 50(/). 



When p is restricted to the subgroup H' C K', it is not irreducible any more. Let 
mo be the multiplicity of the trivial representation in the restriction p\h'- Hence for any 
element y G H' , p{y) G S0{1 — m ) C SO (I) and 50(Z — m ) is embedded as the upper left 
(I — mo) x (/ — m ) block in SO (I). 

With the explicit description of the embeddings, we can prove the following proposition 
on the Weyl group of the new examples. 
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Proposition 3.9. The Weyl group W is isomorphic to Z 2 x Z 2 . 



Proof : For any element x E K' and A E SO(n — m), let M(x, A) denote the block diagonal 
matrix diag(p(x), A) with p(x) E SO(m). If a: G i?', A can be considered as a matrix in 
SO(n - m + 1) since p(rc) G SC^m - 1). 

First notice that u> + can be represented by the an element a G K + = p(H') x SO(n— m+1) 
which is not in H, but a 2 G H. Let 

flm-l \ 
-1 



(3.10) 



w + = M (id, 



) 



V 



In—m—1 / 



where Ik is the k x k identity matrix. 

Suppose b = M{x,A) is a representative of i.e., 6 G N K -(H) and 6 2 but not b E H. 
In the following we will determine the element b in three different cases depending on the 
class one representation p. 

Case 1: p is of real type and mo = 1. In each W = Wi(i = 1, . . . , a), let v be a unit 
vector fixed by p(H')(or equivalently by H) and X be its orthogonal complement. Then 
dimX = 1 — 1. Since b E N K -(H), b.v is also fixed by H and has the same length as v, i.e., 
b.v = ±f . Since b is an orthogonal transformation, b maps X to itself, i.e., when restricted 
on W, b = ( q 1 dc ° 6i ) where b\ E 0(1 — 1). Therefore the representative b has the following 
matrix form: 



(M 



(3.11) 



u>_ = b 



\ 



det A> 



A, 



det A 2 



V 



where A 1 = t(x) E SO(r), A 2 = b\ E 0(1 — 1) and there are a copies of ( A ' 2 dctA2 )■ 

Case 2: p is not of real type and mo = 2. In this case we have \x = v © z/* where v is a 
complex class one representation for the pair (K', H'). If v is of quaternionic type, then v* = 
v and /i = v@v. As in Case 1, we have = X(B±Y where Y is the 2 dimensional subspace 
fixed by p(H') and X is its orthogonal complement. The orthogonal transformation p(x) 
maps X and F to themselves and the matrix p(x) has the form ( q 1 b ° 2 ) G S(0(l — 2) x 0(2)). 
Since ;u(a;) 2 G H implies b\ = I 2 , b 2 is a symmetric matrix. Since p = v © v*, b 2 commutes 
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with the matrix (5 q) which implies 62 = ±-^2- Therefore b also has the matrix form as in 

(gnu). 

Case 3: /i is not in Case 1 or Case 2. From the classification of class one representations 
in Theorem IA.2I and their types in Proposition IA. 191 the only representation of this type 
is (K',H f ) = (Sp(k),Sp(k — 1)) where \i has the highest weight pw\ + qzu 2 with p > 1. 
Here W\ and w 2 are the 1st and 2nd fundamental weights of Spin). Since p is a faithful 
representation, we have x G K' n N K i(H') — if' and x 2 G ii 7 . Take x = —It G Sp(k), then 2 
satisfies these restrictions. If we view Sp(k) as a subgroup of SO(4k), then /1 is contained in 
the restriction of some class one representation v of SO (4k) to Sp(k) by Theorem I A. 11 The 
representation space of v is consisted of homogeneous harmonic polynomials, so the image 
v[x) is ±Id depending on the parity of the degree of the polynomials. Therefore p(x) is 
equal to ±Id and the element W- can be represented by the following matrix: 



(3.12) w^ = b 



(Ax \ 

£ Ial 

\ in J 



where A\ = t(x) G SO(r) and fi(x) = eli with e = ±1. 

In each case, from the given representatives of w±, it is easy to check that w + w_ = w_w + 
which is not an element in H. Thus W =< w + >= Z2 x Z2. □ 

Remark 3.13. Let a be an element in N(H)q which does not lie in N(K~) or N(K + ) and let 
M be the cohomogeneity one manifold defined by the group diagram H C {K~ , aK + a^ 1 } C 
G. As pointed out in Remark l2.3l M and M usually have different Weyl groups and different 
invariant metrics though they are G-equivariantly diffeomorphic. Therefore, if one family 
of invariant metrics does not admit non-negative curvature, it does not necessarily follow 
that the other family is obstructed as well. In our example, if the multiplicity of the trivial 
representation in is equal to one, i.e., mo = 1, then our arguments which show the 
obstructions work for all equivalent diagrams. This is the case for most of the class one 
representations of spherical pairs, see, for example, Theorem IA.21 On the other hand, if 
tuq > 2, then we have to put the further restriction on the diagram: the Lie algebra of 
K + contains the subspace span {E m}Jn+ i, . . . ,E m ^ n }. Here we use E^j, i 7^ j, to denote the 
skew-symmetric matrix having 1 in the i, j-entry, —1 in the j, z-entry and zero otherwise. 



Using the explicit representatives of the generators of the Weyl group, we have the following 
smoothness condition of an invariant metric on M. 
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Lemma 3.14. For any G— invariant metric g on M, let h(t) be the length of the Killing 
vector field generated by E m ^ m+ i along the geodesic c(t). Then h(t) is an even function with 
h(Q) ^ and h(L) = 0. 

Proof : The fact that E m m+ i lies in the Lie algebra of K + but not K~ implies that h(0) ^ 
and h(L) = 0. The generator u>_ is a reflection of c(t) at the point p_ and maps c(t) to 
c(— t). The induced map dw„ takes T C ^M to the tangent space T c i t \M. From the matrix 
form (13.111) and (I3.12p of a representative of w_, we have dw_(E^ m+1 (t j) = ±E] nm+1 (—t). 
Therefore h(t) = h(—t), i.e., hit) is an even function. □ 



4. Restrictions on the Metric Along the Normal Geodesic 

In this section, we begin the study of the invariant metrics in our examples. In general, the 
family of G-invariant metrics on M is very large. There are many rigidity results for positively 
curved metrics. For example, in even dimensions, L. Verdiani classified all positively curved 
cohomogeneity one manifolds, see |Ve2j and |Ve3] . In odd dimensions, K. Grove, B.Wilking 
and W.Ziller obtained a short list of cohomogeneity one manifolds which possibly have 
invariant positively curved metrics in [GVWZJ. Recently K. Grove, L. Verdiani and W.Ziller 
have succeeded in constructing positively metric on one of them in |GVZ] . On the other hand, 
there are few rigidity results for non-negatively curved metrics, even in the cohomogeneity 
one case. Recently, B.Wilking proved some fundamental rigidity theorems for non-negatively 
curved manifolds in a general setting which will play an important role in our proof. 

Let c : R — ► M be a geodesic and let A be an (n — l)-dimensional family of normal Jacobi 
fields. The Ricatti operator L(t) is the endmorphism of the normal bundle (c(t))- 1 defined 
by L(t)J(t) = J'(t) for J G A. From Theorem 9 and Corollary 10 in [Wil] , We have 

Theorem 4.1 (Wilking's Rigidity Theorem). Suppose the Riccati operator for an (n — 1)- 

dimensional family A of normal Jacobi fields is self-adjoint, and define the smooth subbundle 
T oficit)) 1 by: 

T = span {J G A\J(t) = for some t G R} . 
Then, if M has non-negative curvature, we have: 

(4.2) A = Te {J G A| J is parallel}, 



and 



T(t) = {J{t)\J G T} © {J\t)\J G T, J(t) = 0} 
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A point to G K or c(to) is said to be singular if J (to) = for some J G T. Otherwise to is 
said to be generic. Thus if J G A and J (to) _L T(t ) at a generic to, then J is parallel along 
c(t), t G R. 

Remark 4.3. If there exists a subbundle E C (c(t))" 1 " that is invariant under parallel transport, 
then Theorem 14.11 can also be applied to a rank E dimensional family of normal Jacobi fields 
in E with self-adjoint Ricatti operator. 

In our example, let c(t) be the minimal geodesic between B±, and X*(c(t)), 1 6 I) 1 , an 
(n — 1) dimensional family of Jacobi fields. Its Riccati operator L(t) is self adjoint, since it is 
equal to the shape operator — |P t _1 P t ', see f !2.6j) . We will apply Theorem 14.11 to a subfamily 
of these Jacobi fields. 

Let q = so(n) and f) be the Lie algebras of G — SO(n) and H = p(K') x SO(n — in) 
respectively. Choose the bi- invariant inner product Q = — ~Tr on g for which {Eij} is an 
orthonormal basis and let p be the orthogonal complement of f) C g. First we identify some 
subspaces of p. 

Let 

qo = span {Eij | 1 < i < r, m + 1 < j < n} 
(4.4) q x = span {E itj \r + 1 < z < r + /, m + 1 < j < n} 



q a = span {Eij\m + 1 — I < i < m,m + 1 < j < n} , 

and q = qo + qi + • • • + q«. We write the last subspace q a as a sum of two subspaces as 
follows: 

(4.5) ni = span {Eij\m + 1 — I < i < m — 1, m+1 < j <n} , 

n 2 = span {E m j\m + 1 < j < n} . 

Let q x be the Q-orthogonal complement of q in p. Since q -1 is the fixed point set by the 
isotropy action of the subgroup SO(n — m) C H — p(H') x SO(n — m), Schur's lemma 
implies that the Killing vector field X*, I 6 q 1 , is orthogonal along c(t) to Y* for any 
Y G q. 

Terminology. In the rest of the paper, for any two subspaces pi, p2 C p, the notation 
p* _L p2 means that any Killing vector field generated by an element in pi is orthogonal to 
any Killing vector field generated by an element in p2 along c(t). 

Since parallel translation commutes with the action of Ad#, and since q x is the fixed point 
set of SO(n — m) in H, it follows that (q -1 )*, and hence also q*, is invariant under parallel 
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translation. By the same reasoning, P~ 1 P' preserves q* and thus q* forms a self adjoint 
family of Jacobi fields to which we can thus apply Theorem 14.11 

We determine the component T in the splitting (14.21) of the Jacobi fields q*. p + = c(L) 
is a singular point. The element w + fixes p + and reflects c(t) about p + . Let g_ = c(2L) = 
w + {pJ) G £>_, then the isotropy subgroup at g„ is K± = Ad w+ K~ with Lie algebra t{ = 
Ad„, + t~. Similarly, W- fixes p- and reflects c{t) about p_. Let q + = c(—L) = W-{p + ) G B + , 
then q + has isotropy subgroup = Ad w _K + with Lie algebra t£ = Ad w _t + . Since 
W-.w + = w + .W-, the image of g_ under the reflection W- about p_ isw_(g_) = W-.w + {p-) = 
w + .W-(p-) = w + (p^) = g_, i.e., c(2L) = c(— 2L). Therefore c{t) is a closed geodesic with 
period 4L and the singular points are p + = c(L) and q + = c(3L). The vanishing Killing 
vector fields are those generated by the vectors in the Lie algebras of the isotropy subgroups 
at singular points. Notice that if X G q, then X*(j»_) ^ and X*(qJ) ^ 0. Theorem 14.11 
implies 

Lemma 4.6. If Y e q such that Y*{pJ) _L X*(pJ) for all X G n 2 , then Y* is a parallel 
Jacobi field along c(t). 

In the following, we prove some properties of the invariant metrics g on M under the 
non-negative sectional curvatures assumption. 

First we observe 

Lemma 4.7. Suppose (M,g) is non-negatively curved, then ql is orthogonal to (qi + - ■ - + q Q )* 
along c(t). 

Proof : At the generic point p_ = c(0), the metric g restricted to the singular orbit B = 
G/K~ is Adft-- invariant. The actions of Ad^-- on q and q^ {i > 0), are r £g> p n - m and 
/i £g> p n - m respectively, where g n - m is the standard representation of SO{n — m) on M. n ~ m . 
Since r does not contain /z as a subrepresentation, qj^ is orthogonal to q* at p_. In particular 
ql is orthogonal to n^, so any Killing vector field generated by a vector in q is parallel along 
c(t). Hence q|5 is orthogonal to (qi + h q a )* along c(t). □ 

Next we study the metric g on the space (qi + - ■ - + q a )*- Recall h 2 {t) = g(E^ nm+1 , £^ m+1 ) 
is an even function with h(0) ^ and W.L.O.G. we may assume that h(0) = 1. 

4.1. fi is of real type or the multiplicity of ^ in p is one. We first consider the case 
where /i is of real type. We denote -E r +(i-i);+ a ,m+£ by E a ^ for a = 1, . . . , i, i = 1, . . . , a and 
£ = l,...,n-m. 

Since Adx- commutes with -P(O), the restriction of P(0) to q«, composed with the pro- 
jection to qj, is an equivalence between the K~ irreducible representations qj and qj. Since 
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they are orthogonal, Schur's Lemma implies that P(0)(E a ^^) = fi,jE a j^ for some constant 
fij G R. Furthermore, f\j = fj A from the Q-symmetry of P t . In terms of inner product of 
Killing vector fields, we have 

(4-8) f,.j //(/•; , ,./-: / ,) rl): . 

The assumption h(0) = 1 implies that f a>a = 1. 

Lemma 4.9. Suppose (M, g) is non-negatively curved, then we have 

(1) E* ^ is a parallel Jacobi field along c(i) if a ^ I; 

(2) E*i£ is orthogonal to E^^ along c{t) if a ^ b or £ ^ (; 

(3) E*i£ has the same length as E*^ along c(t); 

(4) At the point p^ = c(0) 7 P (E aM ) = YTj=i E aj,£,fi,j- 

Proof : At the generic point c(0), the Ad^- actions on q^ and qj are equivalent and 
given by the irreducible representation /i ® g n -m, from Schur's lemma and the fact that 
H is of real type or the multiplicity of ll in p is one, ^^(O) is orthogonal to T(0) = 
span {Ef a( .(0)\q = 1, . . . ,n — m} for a ^ I. Hence it is a parallel vector field from the last 
part of Theorem 14. II which proves (1). 

On each principal orbit M t = G/H, Ad# acts on each qj (i > 0), by the representation 
Res hi {[x) ® Qn-m- By Schur's lemma we have E*^ is orthogonal to E^-^ along c(t) if £ ^ C, 
and E* A ^ has the same length as E* i ( ^. This proves (3) and one case of (2) where £ ^ (. 

Suppose C = £ an d a ^ b. If none of a or b is equal to /, then the two vector fields E* i ^ 
and El^ are parallel from (1). Using Schur's lemma again and the fact that a ^ b, they are 
orthogonal to each other at c(0) and then along the normal geodesic c(t). 

If one of a and b, say b, is equal to Z, then E* a i ^ is a parallel vector field. Write E*j ^(Q) = 
(Eij^ — XE^ a ^)*(0) + XEi a ^(0), where the constant A is determined by the following equation: 

9( E *,jfr E l,a,t)c{0) = ^9( E l,afr E l,a,t;)c(0)- 

Thus (Eij£ — XEi ta ^)*{0) _L T(0) and hence (Eij^ — XEi a ^)* is a parallel vector field. 
Furthermore, E* i ^ is orthogonal to (Eij^ — XE^ Q ^)* at c(0), so they are orthogonal to each 
other along c(t). Thus E* A ^ is orthogonal to Ef^e along c(t). 

The formula of Po(E ati ^) in (4). follows easily from the defining equation (14.81) of /y and 
(2). ' □ 
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From Lemma fl~9l above, the restriction of the endomorphism P on (cji + • • • + c\ a )* at t — 
has the following matrix form: 

/ fi,ih ■ ■ ■ fi,ah^ 

(4.10) p = ; ••. ; 

\fa,lll ■ ■ ■ fa,ahj 

We have seen that there are plenty of parallel Killing vector fields in (q x + ■ ■ • + q a )*- Using 
these parallel vector fields, we can determine the restriction of P t on (qi H — • + qa)*- 

Theorem 4.11. If the cohomogeneity one manifold {M,g) has non-negative sectional cur- 
vature and the class one representation fi is of real type, then for any i = l,...,a and 
£ — 1, . . . , n — m, we have 

(1) P t (E aM ) = E; =1 k 3 E aM , for a = 1, • • • , I - 1; 

(2) P t (Ei^) = J2 < j=iPi,j( t ) E i,j,i and pi tj (t) is defined as 

(4.12) PiJ (t) = {h 2 {t) - l)a iaj + fij, 
where ai = fi^ a and a a — 1. 

Proof : Part (1) is obvious since every component of both E* i ^ and E* ■ ^ are parallel vector 
fields along c(t) if a < I — 1. 
For part (2), let 

Xi = Ei :i £ — aiEi^^, i — 1, a. 

Then Xj G qi + • — V q a and generates a Killing vector field X* along c(t). By the definition 
a i — fi,ai the defining equation of f\ ta in (14. 8 p and (4) in Lemma [4. 9[ we have 

or X*(0) J_ T(0). Therefore X* is a parallel vector field. By the formula (12.61) of the shape 
operator, we have 

Pl(Xi) = Vt G R. 
Since P t (Ei ti ^) = X^=iPi,i(0-^,:?,£ f° r some functions Pi,j(t), we have 

P/(£ M , ? - aiE^) = Pl(E lM ) - aiP^E^) 

a a 
j=l 3=1 

Therefore we have the following system of ordinary differential equations for Pij(t): 

(4.13) p' itj (t) - aip' Q j (t) = 0. Vi, j = 1, 
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One easily sees that it has the solution 

Pi,j{t) = a^h 2 ^) + f id - Oi/j-,0, 
which finishes our proof. □ 

Now we consider the case when the multiplicity of p in p is one, i.e., a — 1. Since Pi,i(0) is 
symmetric and Ad^- equivariant, the off-diagonal terms in the formulas (12. 9ft and ( 12. 101) of 
equivariant endomorphisms vanish, i.e., Pi,i(0) = f\\Ii with some constant fi t i G R. From 
a similar argument as in the previous case, we have 

Theorem 4.14. If the cohomogeneity one manifold (M,g) has non-negative sectional cur- 
vature and the multiplicity of the class one representation p in p is one, then for any 
£ = 1, . . . , n — m, we have 

(1) P t (E aM ) = h, x E aM , if a = 1, • ■ • , I - 1; 

(2) P t (E l>u )=p hl (t)E lM and Pl , 1 (t) = (h 2 (t)-l)fl 1 + f ltl . 

4.2. p is of complex or quaternionic type. We consider the complex case first and the 
quaternionic case will follow easily. 

Let I = 2p and f3 = 2a. Recall that W{ is the subspace of V such that p\w { = p. Choose an 
orthonormal basis {ei, . . . , e 2p } of Wi such that p(x) has the form \b~a) w ith A, B being 
p x p matrices and p(H') fixes the two vectors e p and e<i%>- Under this basis any Ad^K')- 
equivariant endomorphism has the block-form ^ ^ j as in (12.91) with constants a, b E R. 
Using the fact that the endomorphism commutes with the rotation in the {e p , e2 P } plane, we 
may assume that E m>m G K + . 

Since p is of complex type, the Adx- -equivariant map -P(O) has a block form and the 
(i, j)-block is given by 

f2i-l,2j~\Ip f2i,2j-llp 
f2i-l,2jlp f2i,2jlp 

where f a ^ G R is constant for a, b = 1, . . . , (3 = 2a and satisfies the following identities: 
(4.15) 

J2i-l,2j-l = f2i,2j, f2i,2j-l + /2i-l,2j = 0, f2i-l,2j-l = J2j-l,2i-l, J2i,2j-1 + f2j,2i-l = 0. 

The last two are due to the fact that -P(O) is Q-symmetric. 

Similar to the case when p is of real type, we define -£7 a ,i,£ — -^r+(i-i)p+a,m+5 for a = 1, . . . , p, 
% = 1, . . . , /3 and £ = 1, . . . , n — m. Then we have 

Theorem 4.16. If the cohomogeneity one manifold (M,g) has non-negative sectional cur- 
vature and the class one representation p is of complex type, then for any i = 1, . . . ,/3 and 
£ = 1, . . . , n — m, we have 
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(1) P t (E aM ) = Z-=i fijEajt, if a = 1, • • • ,p - I; 

(2) P t (E Pti> t) = Yfj^PiA^EpM andp itj (t) is defined as 

(4.17) PiJ (t) = (h 2 (t) - l)a ia] + fij, 
where a» = f i>p . 

Now we consider the case when /i is of quaternionic type and the multiplicity of /x in p is 
bigger than one. Let I = 4p and (3 = 4a. 

From the formula ( 12.101) of equivariant endomorphisms in this case and a similar argument 
in the complex case, P(0) = (f a ,bl p )i<a,b<f3 where f a ^ G K. is constant and satisfies the 
following identities: 

J4i-3,4j-3 — fu-1,ij-2 — /4i-l,4j'-l = Hi,4j = fij,4i 

(4.18) — f4i-2,4j-3 — f4i-3,4j-2 = f4i,4j-3 = ~ f4i-l,4j = f4j-l,4i 
—f4i-l,4j-3 — —f4i,4j-2 = f4i-3,4j-l = f4i-2,4j = ~f4j-2,4i 
— f4i,4j-3 — f4i-l,4j-2 = ~f4i-2,4j~l = J4i-3,4j = ~f4j~3,4i 

for i,j — 1, . . . , a. 

We denote E r+{i _ 1)p+atmH by E aM for a = 1, . . . ,p, i = 1, . . . , p and ^ = 1, . . . , n - m, 
and then we have 

Theorem 4.19. If the cohomogeneity one manifold (M,g) has non-negative sectional cur- 
vature and the class one representation \i is of quaternionic type, then for any i — 1, . . . ,/3 
and £ — 1, . . . , n — m, we have 

(1) P t (E aM ) = Y% =1 fijEaj*, if a = 1, • • • ,p - 1; 

(2) P t (E P)i) t) = Yfj^PiA^EpM andPi,j{t) is defined as 

(4.20) PiJ (t) = {h 2 {t) - l)a iaj + fa, 

where a» = 

5. Proof Of Theorem 13.11 

In this section, we will develop some contradiction from the assumption that the manifold 
(M, g) is non-negatively curved. First we list some lemmas which will be used in the proof 
of Theorem 13.11 

Lemma 5.1. The image fi(K') C SO (I) does not act transitively on the sphere S 1 ^ 1 = 
SO{l) /SO{l -I). 
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Proof : Recall that I = deg/i > k + 2. If fi(K') could act transitively on then K' 
would act transitively on both S fc and S>' _1 and I — 1 > k + 1. By the classification of 
the transitive action on the spheres, we have that (K',H') is either (50(7), 50(6)) with 
n(SO(7)) = Spin{7) C 50(8) or {S0{9), S0{8)) with (i(SO(9)) = Spin{9) C 50(16). But 
in both cases, by the classification in Theorem IA.2[ [i is not a class one representation for 
the pair (K', H') which is a contradiction. □ 

The following was already used in [GVWZ] and we state it as a lemma without proof. 

Lemma 5.2. Suppose f(t) is a C 2 non constant even function on (— e, e) for some e > 
with /(O) = ; then there is no such constant 7 > that satisfies the following inequality: 

(5-3) l 2 {f{t)f ~ {f'{t)f > 

We will compute the sectional curvatures for some 2-planes in our examples. The formula 
in terms of Pt is well established in |GZ2] and we quote it for the convenience of the reader. 

Theorem 5.4 (Grove-Ziller). If X,Y e p ; the sectional curvatures of M at c(t) are deter- 
mined by 

(a) g(R(X,Y)X,Y) = Q(A_{X,Y),[X,Y}) -^Q{P[X,Y] P ,[X,Y] P ) 

+Q(A + (X, Y), P-'A+iX, Y)) - Q(A + (X, X), P-'A + (Y, Y)) 
+\Q(P'X 1 Y f - \Q{P'X, X)Q{P% Y) 

(b) g(R(X,Y)T,Y) = - l -Q{P> 'X, P' 1 A + (Y,Y)) + \q{P% P' 1 A + {X,Y)) 

+^Q([X,Y],P'Y) 

(c) g(R(X, T)X, T) = Q((~P" + \p' P^P^X, X). 

Remark 5.5. In the formulas above, [X, Y] p is the p-component of [X, Y] and A± : p x p — > g 
are defined as 

A ± (X,Y) = ^([X,P t Y] T [PtX,Y]). 

From Lemma I3.14[ h(t) is an even function with h(0) 7^ and h(L) = 0, so f(t) = 
h 2 (0) — h 2 (t) = l — h 2 (t) satisfies the assumptions in Lemma I5T21 We will show the inequality 
f)5.3p holds for some constant 7 > using nonnegativity of the sectional curvature of a 
carefully chosen 2-plane. Theorem 13.11 then follows from Lemma 15.21 
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Proof of Theorem \3.1l m In the following argument, only the entries in the lower right 
(n — r) x (n — r)-block of g = so(n) are involved, so without loss of generality we may 
assume that r = or equivalently the representation p is a sum of a copies of /i. 

Case 1: The representation fi is of real type. Since Pq defined in f)4.10p is symmetric and 
positive definite, we can write 



(hi ■■■ fiA 



\fa,l ' ' ' fa,a/ 



ADA 



where A = {Ai t j) axa is an orthogonal matrix and D = diag(di, . . . , d a ) is a diagonal matrix 
with positive entries. Define the following vectors in qi + • • • + q a : 



i-i 



(5.6) 
(5.7) 



X u — biEi^i + Ei tU) 2 

i=l 

i-i 

,u,li 



i=l 



where u — 1, ...,a and Yli=\ b l = 1- Further conditions of the b^s will be determined later 
on. 

In the matrix A, there is a column, say the io-th column, with A a ^ ^ 0. We denote A U ^ Q 
by A u , u — 1, . . . , a, and define the following two vectors X, Y in p: 



(5.* 



X = Y J KX U , Y = Y J A U Y U . 



u=l 



u=l 



From the definitions of X u and Y v , it is easy to see that [X u , Y u ] = 0, and if u ^ v, then 



i-i 



[X u , Y v ] = ^ bi(E v i ji+ (u-i)i + Ei + ( v - 



l)l,ulj 



1=1 



Hence 



i-i 



[X,Y] = ^ A u A„[X u ,y u ] = ^^A„A v 6 i (^ M+(M _ 1)z + J B i+(v _ 1) ^) 

u,v=l i=l Uy^v 

= 0. 



The fact that X commutes with Y makes the computation of the sectional curvature of 
the 2— plane spanned by X* and Y* easier since the first two terms in the curvature formula 
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(a) in Theorem 15.41 vanish. The other four terms are computed in Proposition 15.91 below. If 
we plug in the result of each term into the formula of the sectional curvature, we have 

\\X* A y*|| 2 sec(X*,n c(t) = (h 2 (t) - 1) 2 Q(X ,PT\X )) - (d l0 A a )*h 2 (t)(ti(t)) 2 

- Q{A + {X,X),P t - l A + (X,X)). 

Here X e p is specified in Proposition 15.91 and is orthogonal to f with respect to Q. 

Since P t is positive definite as well as Pf l , we have Q(A + (X, X), Pf 1 A + (X, X)) > 0. 
Therefore sec(X*,Y"*) > implies that 

{h 2 {t) - l) 2 Q(X ,P t -\X )) - {d i0 A a fh 2 {t){h'{t)f > 0. 

The existence of the constant 7 > follows from the facts that A a and Q(Xq, Pf 1 (Xo)) 
is bounded from above near t = 0. 

Case 2: The representation p is not of real type and the multiplicity of p in p equals to 
1. In this case Pq is a scalar matrix and Pt is a diagonal matrix. It is easy to see that the 
proof in the previous case works if we choose X = X 1 and Y = Y 1 in (15. 6p and (15.71) . 

Case 3: The representation p is not of real type and the multiplicity of p in p is bigger 
than 1. Let p = \l and /3 = 2a if // is of complex type and let p = \l and (3 = 4a if it is of 
quaternionic type. In both cases, we have p > k + 2. In each case we define the vector E a ^^ 
for a = 1, . . . ,p, i = 1, . . . , (3 and £ = 1, . . . , n — m. Then similarly we can define vectors X u 
and Y u for u = 1, . . . ,/3 and use them to define the vectors X and Y as in Case 1. The 
formulas of Pt{X) and Pt{Y) are obtained by Theorem 14. 161 and Theorem 14. 191 respectively 
and the rest of the proof will follow Case 1. Note that the number of the constants b^s in 
X or Y is equal to p — 1. The existence of the vector Xq which is orthogonal to t~ follows 
from the fact that p > k + 2. □ 

In the case where p is real type, the non-vanishing terms in the sectional curvature of the 
2-plane spanned by X and Y are computed in the following 

Proposition 5.9. For the vectors X and Y defined in A5.8\) . by choosing a proper value for 
the constant b{, we have 

(1) There exists some X Q e p which is orthogonal to t~ with respect to Q such that 
A + (X,Y) = (h 2 (t)-l)X ; 

(2) A + (X,X)=A + (Y,Y); 

(3) Q(P&X),Y)=0; 

(4) ~Q(Pi(X),X)Q(Pi(X),Y) = -(d l0 A a )'h 2 (t)(h'(t)) 2 . 
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Proof : First we compute the endomorphism P t on X and Y. From the defining equations 
(JESD of X u and ([EZD of Y u , we have 

l— 1 a a 
(5.10) P 4 (X") = + £p„, r (*)^,r,2 



i=l r=l r=l 



and 

(-1 a o 

(5.H) Pt(Y v ) =J2J2 b if«<s E ^ + 52PvAt)Ei,.,i, 

j=l s=l s=l 

then 

i-l l-l a a 

i+(u-l)l,al+l + E u i ta i + 2, &j/^s-Ej+(s-l)«,aZ+2 + (^-E^.crf+l] 

i=l j=l s=l s=l 

l-l \ i-1 « 

&i/u,W — Pv,u{t) J E a i +2 ,al+l + bi{fv,sEi + ( s -l)l tV ,l — Pv,s{t)Ei + (u^i)i )S {) , 

i=l / i=l s=l 



and 

[p t (x«),n = EDftiW i+(r-l)Z,aZ+l + / ] Pu,r(t) E r l >ol i+2 , &j-Ej + („_i)/ ja ; + 2 + ^uJ,erf+l] 



{— 1 a a /— 1 



i=l r=l r=l J=l 

\ i-1 a 



^/«,d — Pu,v{t) J E a i +2 ,al+l + bi(fu,rE v i } i+( r -i)i — p u ,r (£)-Eri,i+(«-l)i) • 



Therefore 
(5.12) 

j i-1 a 

i+(s~i)i,ui+fu,sEi + ( s -i)^ v i—p v ^(t)E i+ ^ u _i^^i—p u ^(t)E i+ ^ v _i- ) i 



2 

1=1 s=l 



From the above equation, only the terms as Ej + r r _iv w i have nonzero coefficients in A + (X, Y) 
and it is denoted by Cj >rtW . From the formula ( 15.12ft and the bi-linearity of A + , we have 



1 / a a \ 

n^J ( ^ ^ (/*•!), r-^-w-^D Pv,w {t)A r A v ^ -\- ^}^(fu,rA u A w p u j^^^y!?.) | 
\v=l u=l / 

tot a 
A w ^ ^ f v ^ r A v — A r ^ ] p„ ;W (t)A t 

We can compute the terms in (I5.13P explicitly as follows, 

a a a 

(5.14) ^ ] fv,rA v = ^ ^ ^ ] A Vt jdjA r jA Vt j = (A T ADA T )i ^ r = di A r ^ = di A r 



v=l v=l i=l 
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and 



v=l v=l 



^ ^ Pv,w (t)A v ^ ^^ {ci v (X w h (t)A v -\- f VjW A v 0>vfw,aA v 

v=l 

a 

di A w -\- {(l w h (t) fw,a) ^ d v A v 



v=l 



di A w + a w (h (t) — 1) ^ ^ fv,aA v 



(5.15) = d io A w + d io a w A a (h (t) - 1), 

where the first equality follows Theorem 14. Ill 

By substituting the new expressions (I5.14p and f 1 5 . 1 5 j) back in the expression (15.131) of 
c j,r, w , we have 

(5.16) Cj ;r)W = -di A r A a a w bj(h 2 (t) - 1). 

If r w, then Ej^ r -x)i,wi is orthogonal to t~ with respect to Q. If r = w, by the formula 
(OB]) for multiple of bj. From the assumption that the representation p is 

the direct sum of /i and the embedding in (I3.8p . the image /i=,,(w)(for any v G t') is block- wise 
diagonally embedded in so(m). Hence if for some r, the vector t> r = Y^j~2\ c j,r,rEj + ( T ^i)^ r i 
is orthogonal to t~ , then all vectors f g 's are orthogonal to £~. By Lemma 15.11 of the non- 
transitivity of the action p{K') on the sphere SO(l)/SO(l — 1) and by choosing the proper 
values of 6j's, v r is orthogonal to t~ . Therefore A + (X,Y) = (h 2 (t) — l)X for some X G p 
which is orthogonal to 6~ with respect to Q and (1) is proved. 

By and floTTOj) . we have 

[X",P t pT)] = (u-l)Z,aZ+l + E u i tCt i + 2, bjf V)S Ej + ( yS „i^i^ a i + i + ^^Pt, )S (t)i? s i iQ / + 2] 

i=l jf=l s=l s=l 

= ^ bjbjf VtS Ej + ( s _i^ i+ ( u _i)i + y^^Pv^jtfEsi^i. 

i^j, Or «t^s s^m 

By (E2D and doTTTj) . we have the same result for P t (r u )], therefore A + (X, X) = [X, P t {X)\ = 
[Y, P t (Y)} = A + (Y, Y) which proves the formula in (2). 

Next we will prove the formulas in (3) and (4) which will finish the proof of the proposition. 
By (15.101) and the differential equation (14.131) for pij we have 

a a 

P' t {X u ) = J2Pr,u(t)Ei, r ,2 = 2h(t)h'(t)J2^a r E l}r , 2 , 

r=l r=l 
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SO 

a / l-l 

Q(Pl(X u ),Y v ) = 2a u h(t)h'(t)J2^r [J2 b jQ( E i,r,2,E j>v ,2)+Q(E l}rt2 ,E ltVt: 

r=l \j=l 

= o, 

and then Q(PftX),Y) = 0. 

By taking the inner product with X v instead of Y v , we have 

a / l-l 

Q(P;(X U ),X V ) = 2a u h{t)ti{t)Y,ar [Y.bjQiE^Ej^) + Q(E hr>2 , E hv , : 

r=l \j'=l 

= 2a u a v h(t)h' (t). 

Therefore 

Q(P;(X),X) = 2(j2 M«a]^'W = 2(^a] h(t)h'(t) 
= 2(d i0 A a ) 2 h(t)h\t), 

where the last equality follows either from (15. 14j) or (15.151) . Similarly for Q(PJ.(Y),Y) and 
hence (4) follows, which finishes the proof. □ 

Remark 5.17. In the introduction, we pointed out that there are unknown but interesting 
cases when m > k + 2 and n = m + 1. The minimal dimension of these manifolds is 15 
when k = 2, m = 5 and n = 6. This manifold has cohomology ring different from the two 
15 dimensional symmetric spaces S> 15 and SO(8)/(SO(5) x 50(3)). The geometry of these 
examples will be studied in another paper. 



6. COHOMOGENEITY ONE MANIFOLDS FOR G = U{n) AND Sp(ri) 

In this section, we will generalize our examples to the cases where G = U(n) and Sp(n). 
First let us state the theorem in each case. 

Theorem 6.1. Let K 1 /H' = S k with k > 2 and p : K' — ► U(m) be a faithful representation. 
Suppose p contains a class one representation p : K' — > U(l) of the pair (K',H') with 
21 > k + 2 and the multiplicity of p in p is 1. For any integer n > m + 2, set G = U (n) and 

K~ = p(K') x U(n - m) C U(m) x U(n - m) C U(n) 
(6.2) K + = p(H') x U(n - m + 1) C U(m - 1) x U(n - m + 1) c U(n) 
H = p(H') xU(n-m) CU(n), 
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then the cohomogeneity one manifold M defined by the groups H C {K , K + } C G does not 
admit a G invariant metric with non-negative sectional curvature. 

Remark 6.3. Proposition IA.22I lists the complex class one representations which have di- 
mension smaller than \{k + 2). It shows that if mul(/x, p) = 1, then only the defining 
representations of SU(l), U(l), Sp(l) and Sp(l) x U(l) are excluded by the above theorem. 
The cohomogeneity one manifolds from these representations are equivariantly diffeomorphic 
to the homogeneous spaces U(n + l)/$>(K f ) x U{n — I + 1) where $ : K' — > U(l) is the 
defining representation, so they carry non- negatively curved metrics. 

Similar to Lemma [5.11 in the orthogonal case, we have the following lemma: 



Lemma 6.4. Assume that K' , H' and \i as in Theorem Iff. II with 21 > k + 2, then p(K') 
does not act transitively on CP' -1 = U(l)/(U(l — 1) x U(l)). 

Proof : From the classification of the transitive actions on complex projective spaces, see 
[Be2] . p. 195, we only need to check the pair {SU(2), £7(1)) for CP 1 , {U(n),U{n - 1)) for 
CP"" 1 and (Sp(n),Sp(n - 1)) for CP 2 ™ -1 . In the first case, the subgroup 17(1) C SU(2) 
does not fix any vector in C 2 . In the last two cases, we have 21 = k + 1 which contradicts 



the assumption on I. Therefore the action of n(K') on CP' 1 is non-transitive. 



□ 



Sketch of the Proof of Theorem \6.l\ Suppose p has the decomposition r © fi and \x is not 
equivalent to any of subrepresentations in r. Let c(t) be the normal geodesic connecting the 
two singular orbits B± = G/K ± with c(0) = p_ G B_ and c(L) = p + G B + . Similar to 
the orthogonal case, the Weyl group is isomorphic to Z2 x Z2 and the generators have the 
following representatives: 



m—l 



\ 



•1 



and 



\ 



A, 



In—r 
±1. 



or 



\ 



eh 



\ 



In—m J 



where A x G U(r), A 2 G U(l — 1) and e 

In addition to the matrices {-Sij}i<j^< n , let F it j be the symmetric matrix with % = y—T 
in the and j, i— entries if i ^ j and \/2i in the i, i— entry if i = j. Then {E iy j} and 
{Fij} form an orthonormal basis of the Lie algebra u(n) of U(n) with Q = — |3ftTr, where 
9ft takes the real part of a complex number. Without loss of generality, we may assume that 
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r = 0, i.e., p — p and then m = I. Let p be the orthogonal complement of the Lie algebra 
() of H in the Lie algebra g = u(n) of G and q be the subspace of p spanned by the vectors 
{E a ^} and {F a ^} for a = 1, . . . , m and i = m + 1, . . . , n. 

Let h 2 {t) = g{E^ m+x , -E'mm+i)c(i) an d then we may assume that h(0) = 1. From Schur's 
Lemma and Wilking's Rigidity Theorem, we have 

Proposition 6.5. Suppose that the metric g is non-negatively curved, then we have 

(1) P(E a!i ) = E a>i and P(F 0)i ) = F a>i , if a = 1, ■ ■ ■ , m - 1; 

(2) P(E m>i ) = h 2 (t)E m ,i and P(F m>i ) = h 2 {t)F m ^, 

where i — m + 1, . . . ,n. 

From the collapsing of the Killing vector field E^ m+l at p + and Weyl symmetry at 
h(t) is an even function and h(L) = 0. Let 

m— 1 m— 1 

X — biEi t m+l + E m ^ m+ 2 + Q-F.m+l + -^m,m+2 

i=l i=l 
m— 1 m— 1 

Y = ^ bjEj jm+ 2 + E m ^ m+ \ + ^ ] CjFj iTn +2 + ^m,m+l) 

where EI=i>? + <f) = 2. 

A computation shows that [X, Y] = and results in the following claim: 

Claim. For properly chosen values of the constants bi and Ci, we have 

(1) There exists some X e p which is orthogonal to t~ , with respect to Q such that 
A + (X,Y) = (h 2 {t)-l)X ; 

(2) A + (X,X) = A + (Y,Y); 

(3) Q(P t '(X),Y)=0; 

(4) -±Q(I*(X),X)Q(Pt(Y),Y) = -A(h{t)h'{t)f. 

The existence of Xq follows from the non-transitivity of the p(K') action on CP' -1 = 
U(l)/(U(l — 1) x U(l)) proved in Lemma \6 .41 The same argument as in the orthogonal case 
shows that the non-negativity of the sectional curvature of the 2— plane spanned by X* and 
Y* gives the desired contradiction. This completes the proof in the unitary case. □ 

Finally we discuss the case where G = Sp(n). 

Theorem 6.6. Let K'/H' = S k with k > 2 and p : K' — ► Sp{m) be a faithful represen- 
tation. Suppose p contains a class one representation p : K' — ► Sp(l) of the pair (K', H') 
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with 4/ > k + 2 and the multiplicity of p in p is 1. For any integer n > m + 2, set G = Sp(n) 
and 

K~ = p(K') x 5p(n — m) C Sp(m) x Sp(?2 — m) C Sp(n) 
(6.7) if + = p(H') x Sp(7i - m + 1) C 5p(m - 1) x Spin - to + 1) C S'p(ri) 
= p(H') x S^n — to) C Sp(n), 

then the cohomogeneity one manifold M defined by the groups H C {-ft' - , C G does not 
admit a G invariant metric with non-negative sectional curvature. 

Remark 6.8. Proposition IA. 231 lists the quaternionic class one representations which have 
dimension smaller than -(A; + 2). It show that only the standard representation of Sp(l) 
for the pair (Sp(l), Sp(l — 1)) is excluded by the above theorem. The cohomogeneity one 
manifold from this representation has non-negatively curved metric since it is equivariantly 
diffeomorphic to the homogeneous space Spin + l)/Sp(l) x Spin — I + 1). 

We have the following result on quaternionic projective spaces which is analogues to 
Lemma [5. II and Lemma [6.41 

Lemma 6.9. Assume that K' , H' and p are as in Theorem \6.6\ with 41 > k + 2, then p{K') 
does not act transitively on HEP' -1 = Sp(l) / (Sp(l — 1) x Sp(l)). 

Proof : From the classification of the transitive actions on HP' -1 , see |Be2] . p. 195, we have 
p(K') = Sp(l) and then H' = Sp(l — 1), p, is the standard representation of K' = Sp(l). 
However in this case, k = 4/ — 1 which contradicts the assumption 4/ > k + 2. □ 

Sketch of the Proof of Theorem \6.0c The proof follows as in the complex case where 
G = U(n) step by step. Suppose {l,i,j, k} is the basis of HI over the reals such that 
i 2 = j 2 = k 2 = — 1 and k = ij. Let Gy denote the symmetric matrix with 1 in the 
and j, i— entries if i ^ j, and y/2 in the i,i— entries. Thus {Eij,iGij, jGij, K,Gij} forms 
an orthonormal basis of the Lie algebra sp(n) of Sp(n) with Q = — |3ftTr. Without loss of 
generality, we may assume that r = 0, i.e., m — l. 

Let h 2 (t) = giyE^ m+1 , E* m m+1 ) c (t) and we may assume that h(0) = 1. For the endo- 
morphism P t , one proves the following proposition which is similar to the orthogonal and 
complex cases. 

Proposition 6.10. Suppose that the metric g is non-negatively curved, then we have 

(1) P(E a>i ) = E a>i and P(6G a , t ) = 6G afl , if a = 1, ■ • • , to - 1; 

(2) P(E m>i ) = h 2 {t)E m>l and P(9G mji ) = h 2 {t)6G m , l; 
where i — to + 1, . . . , n and 9 can be one of i, j and n. 
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Furthermore, h(t) is an even function with h(L) = 0. To get the desired contradiction we 
choose the vectors X and Y as follows: 



m—1 m—1 



X — ^ ] 6j-Ej jm+ i + E mtTn+ 2 + ^ ] c i^i,m+l + c G m ,m+2i 



i=l i=l 
m—1 m—1 



,m+2 + E m 

,m+l m,m+l j 

where c = i + j + k, fej's are real numbers and q's are pure quaternionic numbers, i.e. the 
real part is zero. These constants satisfy the equation 1 — c 2 — Yli=i(b 2 ~ c l) = 0- 
A computation shows that [X, Y] = and the following claim: 

Claim. For properly chosen values of the constants b{ and Cj, we have 

(1) There exists some Xq g p which orthogonal to t~, with respect to Q such that 
A + (X,Y) = (h 2 (t)-h 2 (0))X ; 

(2) A + (X,X) = A + (Y 1 Y); 

(3) g(p;(x),r)=o ; 

(4) -ig(p;(x),x)g(p/(F),F) = -i6(h(t)h'(t)f. 

The existence of Xo follows from the non-transitivity of the fi(K') action on HP i_1 proved 
in Lemma 16.91 The contradiction now follows as in the orthogonal case. □ 



Appendix A. Class One Representations of Sphere Group Pairs 

In this appendix, we shall classify all class one representations of spherical pairs. Except 
for the last section, all representations are considered over the complex numbers. 

First we reduce our classification to the case where the group action on the sphere is 
almost effective. Suppose K, H are compact Lie groups, K is connected and K/H = S n_1 
with n > 2. If the K action is not almost effective, then let C be the ineffective kernel, i.e. 
the maximal normal subgroup of K contained in H. Thus we can write K — C x K\ and 
H = C x H\. Suppose /i®r is a class one representation of the pair (K, H), i.e., /x and r are 
irreducible representations of C and K\ respectively and Res(/i ® r) fixes a non-zero vector, 
i.e., the trivial representation of C X Hi appears in the decomposition of // <S> r. Therefore 
fi is the trivial representation of C and r is a class one representation of the pair (K±, Hi). 
Therefore in the rest, we only consider almost effective action on the spheres. 
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The classification of transitive and effective action on spheres by connected compact Lie 
groups is well known, see for example Page 179 in |Belj or Page 195 in |Be2] . Using repre- 
sentation theory of compact Lie groups, it is easy to extend the classification to the almost 
effective case: 

• SO{n)/SO{n - 1) = ^(n > 3), 

• SU{n)/SU{n - 1) = S 2n -\n > 2), 

• U{n)/U{n - l) m = § 2n - 4 (n > 1 and m E Z), 

• Sp(n)/Sp(n - 1) = $ An -\n > 1), 

• Sp(n) x Sp{l)/{Sp{n - 1) x Sp(l)) = § 4n - 4 (n > 1), 

• Sp{n) x U(l)/{Sp{n - 1) x U(l)) m = S 4 ™" 1 ^ > 1 and m E Z, m ^ 0), 

• G 2 /SU(3) = § 6 , Spin(7)/G 2 = S 7 , Spin(9) / Spin(7) = § 15 . 

The group U(n) can act on the sphere § 2n_1 in different ways. For each m E Z, A E U(n) 
can act on C n via z t— > (det A) m A.z. It induces a transitive action on S 2 ™^ 1 c C n and the 
isotropy subgroup at z = (1, 0, • • ■ , 0) T is 

U(n - l) m = {diag(a, B) E U(n)\a m+1 = (det 5)~ m , a G C/"(l) and B E U(n - 1)} . 

If n = 1, then £7(1) acts on the circle S 1 and the isotropy subgroup is Z m+ i(m ^ —1) and 
it gives us all almost effective actions on the circle. In Table Q], we only list the case when 
the U{\) action on S 1 is effective and the corresponding results in the almost effective case 
easily follows. 

Similarly the group Sp(n) x U (1) has different transitive actions on S 4n_1 . For each m E Z, 
(A, z) E Sp{n) x Z7(l) acts on H n via q t— > A.qz m . The isotropy subgroup at q — (0, • • • , 0, 1) T 
is 

Sp(n-1) x U(l) m = {(di&g(A,z- m ),z) E Spin) x U{l)\z E U{1) and A E Spin ~ 1)} . 

For each spherical pair (K,H) with K/H = § n_1 , the defining representation $ : K — > 
SO(n) is of class one. If the pair is (SO(n), SO(n — 1)), then the class one representations 
are well known. They consist of the irreducible representations on the space of homogeneous 
harmonic polynomials. In fact the class one representations of the spherical pairs are closely 
related to these representations as stated in the following theorem. 

Theorem A.l. The representation u is a class one representation of the spherical pair 
(K, H) if and only if u is in the decomposition of Resf?^ p, where p is a class one repre- 
sentation of the pair (SO(n), SO(n — 1)) and K is viewed as a subgroup of SO(n) via the 
representation <3>. 
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The proof of the above theorem is given in Section IA.1I 

For a compact Lie group, the irreducible representations are highest weight representations 
and each highest weight is a linear combination of the fundamental weights with nonnegative 
integers as coefficients. We list the fundamental weights for classical groups as follows. 



SO(n) 


: W\ 


= d, • • 


■ ,TZk-\ 


= ei + e 2 H h e fc _i, = ~(ei H 


+ e fc ), n = 


= 2k+l, 




W\ 


= ei,-- 


" ? w k-\ 


= |(ei H h e fc _i - e fe ), tzj fc = I( ei + 


V efc), 


n = 2k, 


SU{n) 


: V3\ 


= ei,-- 


' , w n-\ 


= ei H h e„_i, with e\ H he„ = 


o, 




Sp{n) 


: W\ 


= ei, • ■ 


' j w n — 


ei H h e„. 







The exceptional Lie group G<i has two fundamental weights: W\ which is the highest weight 
of the 7 dimensional representation and wi which is 14 dimensional. 

The group U(n) has a finite cover SU(n) x U(l) and hence its irreducible representations 
can be written as p®cf) k where /i is an irreducible representation of SU(n) and <ft k (k 6 Z) is 
the 1 dimensional representation of U(l): v t— > z k v for any 2 G Hence an irreducible 

representation p of Z7(n) with highest weight a\e\ + . . . + a„e n ( ai > . . . > a n ) is the tensor 
product of an irreducible representation // of SU{n) and fc of £7(1) where // has highest 
weight (ai — a n )ei + . . . + (a n _i — a n )e n _i and fc = — (oi + . . . + an)- Note that the standard 
representation of U(n) on C n , i.e., matrix multiplication from the left, has the highest weight 

In order to determine the class one representations for each pair (K, H) , we use the branch- 
ing rules, i.e. the rules that show how an irreducible representation of K decomposes under 
the restriction functor Res^. If the trivial representation of H appears in the decomposition, 
then this representation is of class one. We have the following classification result: 

Theorem A. 2. For each almost effective spherical pair (K,H), Table[l\ gives the classifica- 
tion of all complex irreducible class one representations p. 

The multiplicity of the trivial representation of H in Res^(p) is equal to 1 except for the 
pair (Sp(n), Sp(n — 1)) where it is a + 1 if p has the highest weight aw% + bw-i- 

In the table the numbers a and b are non-negative integers and k is an integer. In the pair 

(Sp(n) x U(l),Sp(n — 1) x U(l) m ), a, b and k satisfy further restriction, denoted by (S): 

k \k\ 
a + b > I, Iml divides k, a and - — - have the same parity and - — , < a. For other pairs, the 

\m\ \m\ 

restrictions are specified in the table. 

In Tabled! if n = 1 for the Sp(n) factor, then there does not exist bvu2 in p, i-e., 6 = 0. 

The proof of Theorem IA.2I is divided into four parts. The results of the first four group 
pairs in Table [1] are direct consequences of the classical branching rules for those pairs. The 
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K 


H 


P 




n 


SO{n) 


SOin - 1) 


aw\ 


a > 1 


n > 3 


SU(n) 


SU(n - 1) 


aw\ + bw n -\ 


a + 6 > 1 


n > 3 


U(n) 


U{n - l) m 


aei - be n + m(a - 6)(ei H h e n ) 


a + b > 1 


n > 2 


Spin) 


Spin — 1) 


aw i + 6^72 


a + 6 > 1 


n > 1 


Spin) x Sp(l) 


Spin - 1) x Sp(l) 


(aw\ + bw 2 ) <8> a.s7i 


a + 6 > 1 


71 > 1 


Sp{n) x 17(1) 


Spin - 1) x U(l) m 






n > 1 


G 2 


SU(3) 


aw i 


a > 1 




Spini7) 


G 2 




a > 1 




Spini9) 


Spini7) 




a + b > 1 




U(l) 


{1} 




A;^0 





Table 1. Complex class one representations of spherical pairs 



second part includes the pairs (Sp(n) x Sp(l), Spin — 1) x Sp(l)) and (Sp(n) x £7(1), 5p(n — 
1) x U (l)m)- They will be proved in the Section DOl by using a branching rule of J. Lepowsky. 
The third part is covered in Section IA.31 We will apply Kostant's Branching Theorem to 
each pair to obtain the class one representations. The result for the last pair (£7(1), {1}) is 
clear. 

In the last section, Section lA. 41 we will study some properties of these representations, for 
example, the type, the kernel and the dimension. 

A.l. The Class One Representations and Harmonic Polynomials. In this section we 
prove Theorem IA.1I and provide an explicit characterization of class one representations for 
the pairs (SU(n), SUin — 1)) and (£7(tj), £7(n — l) m ) using harmonic polynomials. 

Proof of Theorem \A.1\ : We consider the separable Hilbert space 7i of all the square- 
integrable complex valued functions defined on S n_1 under the following inner-product 

</i,/ 2 >= / hhda, VA,/ 2 eW, 

where da is an SOin) bi-invariant measure on S™" 1 with total measure = 1. 

Using the SOin) action on S n_1 , SOin) acts on TC by g*f(x) = fig~ 1 x) for any g 6 SO{n). 
This representation is called the left-regular representation of SOin) on Tt and it is a unitary 
representation. 

Since SOin) / SOin — 1) = S n_1 is a homogeneous space, Ti is also the induced represen- 
tation H = Ind^Q/^jJd, where Id is the trivial representation of SOin — 1) on C, see for 
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example, Chapter 9.2 in |Knj . By the Frobenius reciprocity, for any irreducible representa- 
tion p of SO(n), we have the following multiplicities equality 

[ Ind 50(n-l) Id : P] = [ ReS 50(n-l)P : Id L OT [ H : P] = [ Re 4S(n-l)P : M ]> 

where [p± : p?\ denotes the multiplicity of the irreducible representation pi in p\. By the 
classical branching rule for the pair (50(71), SO(n - 1)), [Res S s °^_ 1)P : Id] ^ if and only if 
p has the highest weight ae\ where a is a nonnegative integer. On the other hand, for any 
class one representation p, \f^sotn-i)P : Id] = 1, or equivalently [H : p] = 1. 

The representation with highest weight ae\ can be realized as the the representation of the 
complex valued homogeneous harmonic polynomials with degree a on S n_1 which is denoted 
by Ti a . Furthermore, Ti a is the complexification of the real valued homogeneous harmonic 
polynomials with degree a. We have the following orthogonal decomposition 

00 

n = 0ft a . 

Since K/H = S n_1 , K acts on the Hilbert space Ti and Ti = Ind^Id, where Id is the 
trivial representation of H on C. As a subgroup of SO(n), K acts invariantly on 7i a . In 
general 7i a is not an irreducible representation of K and it is decomposed orthogonally into 
irreducible summands as follows: 

Resf? {n) H a = @H a ' b , 
b 

and there are only finite many b's for each value of a. Hence we have the following orthogonal 
decomposition of TC into irreducible representations of K: 

H = Q)H a > b . 

a.b 

Suppose /i is an irreducible representation of K, then p is of class one for the pair (K, H) if 
and only if [H : p] 7^ by the Frobenius reciprocity applied to the pair (K, H). Then from 
the above decomposition and the uniqueness of this decomposition, p is equivalent to H a ' b . 
□ 

Remark A. 3. The existence and uniqueness of the decomposition of Ti follow from Theorem 
9.4 and Corollary 9.6 in |Knj . 

Next using harmonic polynomials, we construct the representation space of the class one 
representations p = aw\ + bzu n -i for the pair (K,H) = (SU(n), SU(n — 1)) and p = 
aei — be n + m(a — b)(ei + • ■ ■ + e n ) for the pair (K, H) = (U(n), U(n — l) m ). It is already 
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discussed for the pair (SU(n), SU(n — 1)) in [Knj . In the following, we consider the pair 
(U(n),U(n-l) m ). 

Let {zi, • • • , z n } be the basis of C n and A G K acts on it by the defining representation 
$ m (A) : {zi,-- - ,z n ) T h-» (det A) m A.(z 1 , ■ ■ ■ , z n ) T . If A G SU(n), then $ m (A) is just matrix 

z n y to (detA) m A.( Zl ,--- ,z n ) T . Let V be 
, z n , Zi, ■ ■ ■ , z n of degree a + b. A acts on V 



multiplication. Similarly 3> m (A) maps (21, •• 
the space of homogeneous polynomials in 
by 



®m(A) : P( 



AA 


■1 




w 







m a-1 



P((det A)~ m A 



,(det A)-" 1 ^- 1 



«A 



Let V^f, be the subspace of polynomials with degree a in 2 and degree b in z. Clearly K 
leaves V a t, invariant. The Laplacian operator A is a multiple of V"™, ~ and it commutes 
with the .fT action, so the subspace i/ ai b of harmonic polynomials in V a ,b is an invariant 
subspace. 

If P is a monomial of the form 

n n 

P(z, z) = z\ 1 ■■■ z* n z l i ■■■z 1 ™ with ^ kj = a and V] = 6, 

j=i j=i 

then P is a weight vector of weight 5^j=i(^i — ^') e i + m ( a — ^)( e i + ' ' ' + e «)- Hence 
p = aei — be n + m(a — b)(e\ H — • + e„) is the highest weight of the representation H a b with 
the weight vector z\z\. From Exercise 17 of Chapter IV in |Knj . the dimension of H a b is 
"^-i" 1 (° + a~ 2 ) ( & n-2 2 ) wn i c ' 1 equals to the dimension of the irreducible representation of K 
with the highest weight p, see, for example, Proposition IA.201 so H a b is the representation 
space as desired. 

A.2. The Pairs (Spin) x Sp{\), Sp(n - 1) x Sp(l)) and (Sp(n) x £7(1), Sp(n - 1) x U(l) m ). 
For each pair (K, H), there is an intermediate group L and we will apply the branching rule 
successively as Res^p = Res^-(Res^p) for any irreducible representation p of K. 

The branching rule we will use is the one for the pair (Sp(n), Sp{n — 1) x Sp{l)) which is 
established by J. Lepowsky in [Lej. For each irreducible representation /ii<S>^2 of Sp(n—1) x 
Sp(l), let /i = biei + ■ • • + 6 n _ie n _i + b n e n be the highest weight, then b± > • • • > 6 n _i > 
and b n > 0. 

Definition A. 4. Let I, m G Z, m > 1 and let q±, ■ ■ ■ ,q m be positive integers. Suppose there 
are I identical balls, m different boxes and the z-th box can contain at most g« balls. We 
define F m (l; ?i, • • • , q m ) to be the number of ways of putting the I balls into the m boxes. 
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Theorem A. 5 (Lepowsky). Let p, p be irreducible representations of Sp(n), Sp(n—l)xSp(l) 
with highest weights p = a\e\ + • • • a n e n , p = b\e\ + • • • &„_ie n _i + b n e n respectively. Let 

Ai = ai — max(ci2, bi), 

Ai = min(aj, - max(a i+1 , k) (2 < i < n - 1), 
A n = min(a n , 6 n _i) 

Then the multiplicity [Resp : p] = unless Xir=i( a * + ^«) 2Z and A±, • • • , A n _\ > 0. Under 
these conditions, 

[Resp:p] = F^^bn- A 1 + Y^A i );A 2 ,--- ,A^J 

- F n _i {^{-K -A 1 + J2A i )-l;A 2 ,---, A,}j . 



(A.6) 



Proof of the 2nd part of Theorem ] A. 2\ : Let K = Sp(n) x Sp(l) and H = Sp(n — 1) x Sp(l), 
then L = Spin — 1) x Sp{l) x Sp(l) lies between if and K, and the Sp(l) factor in H is 
diagonally embedded in Sp(l) x Sp(l) C L. Suppose p = p\® p 2 is a class one representation 
of the pair (i^, if) and pi has the highest weight a\C\ + • • • + a n e n and p2 has the highest 
weight be\. Then Res^p = i^^sp(ri~i)x Sp^P 1 ) ®P2- Since the trivial representation appears 
in Res^p, it appears in (Res^-p) ® p 2 for some irreducible representation p = pi ® p 2 
in Res^l^-^^-^pi. Under the restriction from Sp(n — 1) x Sp(l) x Sp(l) to Sp(n — 

'A5p(l) 



1) x AS , p(l), pi ® p 2 ® p 2 splits as pi ® 

Res^^ 1 ^^®^)- Therefore pi is a trivial 



representation of Spin — 1) and p2, P2 have the same dimension, i.e., ^^sptn-^xSpi^P 1 
contains the representation Id ® P2 which has the highest weight be n . From Theorem IA.51 
we have A\ = a± — a 2 > 0, A 2 = — a 3 > 0, . . ., A n ^i = —a n > 0, b + ai + a 2 is an even 
number and the multiplicity is equal to 

p = Q(6 - (oi - a 2 )); 0, • • • , 0J - F n _! Q(-6 - (ai - a 2 )) - 1; 0, • • • , 

Hence p ^ if and only if b = a\ — a 2 and in this case we have p — 1. 

For the second part, we give a proof when m = 1 and the general case easily follows from 
this case. Let K = Spin) x U(l), H = Sp(n-1) x U(l), K x = Sp(n-1) x Sp(l) x 17(1) and 
= Spin - 1) x U{1) x £7(1), then we have the embedding H d Ki d K 2 d K and [7(1) 
in if lies diagonally in t/(l) x C K x . Suppose p = p ® 4> k is a class one representation 
of the pair [K, H) and p has the highest weight p, — a\e\ + • • • + a n e n - From the first part 
of the proof, we have a 3 = • ■ ■ = a n = and the multiplicity of the trivial representation in 
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Res^p is equal to the multiplicity of the trivial representation in (Res^^ (a\ — a 2 )e n ) ® <p k . 
Therefore k, a\ — a 2 have the same parity, \k\ < a± — a 2 and the multiplicity is 1. □ 

A.3. The Pairs (G 2 ,SU(3)), (Spin(7),G 2 ) and (Spin(9), Spin{7)). In this section, we will 
develop the branching rule for each group pair and then prove the corresponding result in 
Theorem I A. 21 The main tool is Kostant's Branching Theorem. We quote the statement of 
the theorem from [Knj . 

First we establish the notation we will use. Let K be a connected compact Lie group 
and let if be a connected closed subgroup. Choose a maximal torus S C H . The special 
assumption is that the centralizer of S in K is a maximal torus T of K. Let Ak be the set 
of the roots of (E c , t c ), let A H be the set of roots of (f) c ,s c ), and let Wk be the Weyl group 
of Ak- Introduce compatible positive systems A^ and A^, let bar denote restriction from 
the dual (t c )* to the dual (s c )*, and let 5k be half the sum of the members in A K . The 
restrictions to s c of the members of A K , repeated according to their multiplicities, are the 
nonzero positive weights of s c in t c . Deleting from this set the members of A^-, each with 
multiplicity 1, we obtain the set E of positive weights of s c in t c /f) c , repeated according to 
multiplicities. The associated Kostant partition function is defined as follows: V[y) is the 
number of ways that a member of (s c )* can be written as a sum of members of E, with the 
multiple versions of a member of E being regarded as distinct. 

Theorem A. 7 (Kostant's Branching Theorem). Let K be a compact connected Lie group, 
let H be a closed connected subgroup, suppose that the centralizer in K of a maximal torus S 
of H is abelian and is therefore a maximal torus T of K , and let other notation be as above. 
Let p be an irreducible representation of K with the highest weight p G (t c )*, and let p be an 
irreducible representation of H with the highest weight p e (s c )*. Then the multiplicity of p 
in the restriction of p to H is given by 

[p:p]= ^2 £{w)T J {w(p + 8 K ) - 5 K - p). 

Remark A. 8. To apply this theorem to our special examples, we will use an equivalent 
assumption on the Cartan subalgebras instead of the maximal tori: the centralizer of s in f) 
is a Cartan subalgebra t of £. In our three group pairs, this assumption is verified. 

To apply Kostant Branching Theorem, we need to work out the explicit embeddings of 
the Lie algebras. These groups and Lie algebras are well studied, see, for examples, [G1WZ] 
and [MuJ and references given there. 
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We start with the pair (Spin(9), Spin(7)). Let O be the set of the Cayley numbers which 
is isomorphic to IR 8 as vector spaces. SO(8) acts on O by left multiplication and we have 
the Principle of Triality: 

Proposition A. 9. For each 9i £ SO(8), there exists 9 2 , 9 3 £ 5*0(8) such that 

(A.10) 9 1 (x)9 2 (y) =9 3 (xy), foranyx,yeO 

Moreover if 9' 2 , 9' 3 satisfy the above equation as 9 2 , 9 3 , then (9' 2 ,9' 3 ) = ±(# 2 ,# 3 ). 

The infinitesimal version of the above principle is given as follows: 
Proposition A. 11. For any X £ so(8), there exist Y , Z £ so(8) such that 
(A. 12) (Xx)y + x(Yy) = Z(xy) foranyx,yEO. 

Moreover Y , Z is uniquely determined by X with Y = X(X), Z = Xn(X) and X, k are two 
outer automorphisms of so (8) with A 3 = 1, k 2 = 1 and kX 2 = Xk. 

We identify 0©0 with IR 16 and then Spin(9) C 50(16) acts transitively on § 15 C 0©0. 
Let vo £ IR C O be the unit length vector, then Spin{7) is the isotropy subgroup at (vq, 0). 
Consider the following Hopf fibration: 

§ 7 — > § 15 — > § 8 = OU {oo} , 
(x,y) ^ y- l x. 

The isotropy subgroup of the fiber {(x, 0)\x £ O} is given as follows: 

(A.13) 

Spin{8) = |(0i,0 2 ) e S0{8) x SO(8)\39 3 £ 50(8) such that 9 1 (x)9 2 (y) = 9 3 {xy)} , 

and the embedding of Spin{7) C Spin{8) is 



(A.14) Spin(7) = (9 U 9 2 ) £ Spm{8)\9 l £ 50(7) c 50(8) or 9 1 {x)9 2 (y) = 9 2 (xy) . 



The automorphism 9 t— > (x t— > 9(x)) of 50(8) induces the automorphism k. Let 9\ = 
exp(X), 9 2 = exp(F) and 9 3 = exp(Z). From Proposition lA.llj we have X = X(kZ) and 
Y = X 2 (kZ), so we can write the Lie algebra of Spin(8) as 

Lie(5pm(8)) = {(A(X), A 2 (X))|X £ so(8)} . 

From the embedding of Spin(7) C Spin(8) in (IA.14I) . since 9i £ 50(7) we have the Lie 
algebra of Spin{7) as 

Lie(5pm(7)) = {(Y, X(Y))\Y £ so(7)} C Lie(5pm(8)). 
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Therefore if we identify Lie(Spin(8)) with so(8) by its first component, then we have 

(A.15) Lie{Spin{7)) = {A 2 (X)|X G so(7)} . 

Let {ti ± \ < i < j < 4} be the positive root system of so(8) with vanishing e± on so (7), 
then the automorphism A 2 induces the following transformation of e^. 



(A.16) 



A 



e 2 
e 3 
W 



( 



\-\ 



-\) 



AA 

e 2 
e 3 
W 



In ( 1A.14I) the ^-component acts transitively on S 7 C O and the isotropy subgroup at Vq 
is G2- Since n is the identity map on 50(7), 9i(x)9 2 (y) = 2 (xy) for ^ £ G2 C 5*0(7) which 
implies #1 = #2- Hence we have 

G 2 = {(0,0)\0 G 50(7) and 9(x)0(y) = 6(xy), for any ijgO}, 

and the Lie algebra is 

2 = {(X,X)\X G so(7),X = A(X)} . 

If we identify Lie(Spin(7)) with So(7), then we have 

2 = {X|Xgso(7),X = A(X)}. 

Choose a basis of O over K, then we can write down the explicit embedding of 02, see also 
in [Muj . The typical element of 02 has the following form: 

/ 

-x 1 + y 1 

-%3 ~ 2/3 



X3 + V3 

a 




-x 2 + 2/2 

2/5 



-x 4 - 2/4 
2/6 

x 5 

b 



— Xi 

-x 3 



+ 2/6 
2/4 

£2 

2/3 



—a — 6 



£5 - 2/5 \ 

2/2 

2/1 

x 3 

a + 6 




- 2/1 


— a 

Y = x 2 - 2/2 -2/5 -^6 

£4 + 2/4 -2/6 -X6 -6 

-2* - 2/6 -2/4 -z 2 -2/3 

V-^5 + 2/5 -2/2 -2:4 -2/1 

where a, 6, Xi, ■ • • , x 6 , 2/1, • ■ ■ , 2/e e R. 

The linear functionals {ex, 62,63} of the Cartan subalgebra of SO (7) satisfy the relation 
6i = e 2 + e 3 when restricted to the Cartan subalgebra of 2 . Suppose {cti, a 2 } be the set of 
the positive simple roots of G 2 where aii is the short one, then under the restriction, = aii 
and e2 — e3 = a 2 . 

We consider the last pair (G 2 , SU(3)). G 2 acts transitively on the unit sphere S 6 = 
{x G 0| ||a;|| = 1, < x, v >= 0}. Let V\ be a unit element which is orthogonal to v , then the 
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isotropy group at V\ is isomorphic to SU(3) C SO(6). Since G 2 and 577(3) share the same 
maximal torus, the restriction of the roots of 02 is the identity map. 

In the proof we will use the classical branching rules for the special orthogonal groups 
which are well-known and the proof can be found, for examples, in [KnJ. 

Theorem A. 17 (Branching Rule for (so(2k + l),so(2A;))). The irreducible representation 
with highest weight a\e\ + a 2 e 2 + • • ■ + a,kGk ofso(2k + 1) decomposes with multiplicity 1 under 
so(2k), and the representations of so(2k) that appear are exactly those with highest weights 
fi = c\C\ + c 2 e 2 + ■ • ■ + c^efc) such that 

a-i > c\ > a 2 > c 2 > ■ ■ ■ > a k > \cu \ , 

where a^i = 1,2, ••• ,k) are integers or all half integers and cj(j = 1,2, ■ ■ ■ , k) are all 
integers or all half integers. 

Theorem A. 18 (Branching Rule for (so(2k) , so(2k — 1))). The irreducible representation 
with highest weight a\&\ + a 2 e 2 + ■ • ■ + a^k of so{2k) decomposes with multiplicity 1 under 
so(2k — 1), and the representations of so(2k — 1) that appear are exactly those with highest 
weights \i = c\C\ + c 2 e 2 + • ■ • + Ck-iek-i) such that 

a\ > ci > a 2 > c 2 > ■ ■ ■ > c fc _! > \a k \ , 

where Oj(z = 1,2, ■ ■ ■ , k) are integers or all half integers and Cj(j = 1, 2, • • • , k — 1) are all 
integers or all half integers. 

Proof of the 3rd Part of Theorem \A.2c First let K = Spin(9), H = Spin(7) and £ = 
Lie(Spin(9)), f) = Lie(Spin(7)) be their Lie algebras. L = Spin(8) lies between them and 
denote its Lie algebra Lie(Spm(8)) by [. Let 

A+ = {d ± e,-[l < i < j < 4} U {e t \l < i < 4} , 

be the positive root system of t, and then [ has the positive roots system 

A+ = {e i ±e i |l<i<j<4}. 

Since t and [ share the same Cartan subalgebra, S = {ei, e 2 , e^, e±}. Therefore the branching 
rule for the pair (t, [) is the same as the classical one for (so(9), so(8)). 

Let fi = A 2 (ej) for i = 1,2, 3, 4. Since A is an automorphism of so(8), we can write 

A+ = {f i ±f j \l<i<j<4}, 

and f) has the positive root system 

A+ = ± fj\l < i < j < 3} U {fi\l < i < 3} . 



NEW EXAMPLES OF OBSTRUCTIONS 



39 



Therefore £ = {/i, f 2 , Z^}. The Weyl group W 7 ^ also acts on /j's and = 3ei + 2e2 + = 
3fi + 2/ 2 + /3- Suppose /x be an irreducible representation of K with the highest weight 
P — + 62/2 + ^3/3 + ^4/4, then by the classical branching rule for (so (8), so (7)), /i 
decomposes with multiplicity 1 when restricted to f), and the representations of f) that 
appear are exactly those with highest weights r = ci/i + C2/2 + C3/3 such that 

&i > ci > 6 2 > c 2 > 63 > c 3 > |6 4 | , 

where ^(z = 1, 2, 3, 4) and Cj(j = 1, 2, 3) are all integers or half integers. Therefore the class 
one representations of the pair (K, H) are exactly those with the highest weights bfi where 
b G Z, or \b{e\ + • • • + €4) and the multiplicity of trivial representation is 1. 

Now suppose that \i is a class one representation of the pair (K, H) with the highest weight 
p = a\e\ + • • • + 0464, then Res^p contains at least one representation with highest weight 
|6(ei + • ■ ■ + e^j. From the branching rule of (so(9),so(8)), we have 

!, 1, 1, 1, 

ai > -b > a 2 > - b> a 3 > - 6 > a 4 > -b. 

Therefore a± > a 2 = 03 = > and all are integers or half integers. If a^'s satisfy the 
conditions, then p contains only one representation with the highest weight p which implies 
that [Resf p :Id] = l. 

Next we look at the pair (K, H) = (Spin(7), G 2 ). We identify t with so(7) so that 

A+ = {e i ±e j \l < i < j < 3} U {e^l < % < 3} . 

By the relation e\ = e 2 + e 3 and the restriction = cti, e 2 — e 3 = a 2 , we have 

A^ = {«i, 3«i + 2a 2 , «i + «2, 3«i + a 2 , a 2 , 2«i + a 2 , 2«i + a 2 , «i + cn 2 , ai} 

under the restriction. In terms of a,\, a 2 , f) has the following positive root system 

A^ = {a l5 a 2 , ai + a 2 , 2a\ + a 2 , 3ai + a 2 , 3«i + 2a 2 } . 

Therefore £ = {ai, «i + a 2 , 2ai + a 2 }. The Weyl group Wk permutes {ei,e 2 ,e 3 } and 
changes the sign of each e,. 

Let p be a class one representation with the highest weight p = a\e\ + a 2 e 2 + a 3 e 3 (ai > 
^2 > % > 0). Then from the Kostant's Branching Theorem I A. 7} by a computation, the 
multiplicity of the trivial representation Id of G 2 in Resp is 

p = (ai +03 + 1) — (ai — CI3) — (ai + a3) + max{0, a± — 03 — 1} — (ai — 03 — l) + max{0, ai — 03 — 1}. 
Therefore p 7^ if and only if a± = a 3 , i.e., ai = a 2 = a 3 . Thus in this case we have p — 1. 
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Finally we look at the pair (K, H) = (G 2 , £{7(3)). t = Q 2 and f) = su(3) share the same 
Cartan subalgebra and hence the restriction of the roots is the identity map. t has the 
following positive root system 

Ajt = 3«i + a 2 , 1oL X + a 2 , 3«i + 2a 2 , cti + a 2 , a 2 } , 

where ai = e 3 , a 2 = e 2 — e 3 and e 2 + e 3 — t\ = 0. Among the 12 roots of t, the six long roots 
consist the root system of h, i.e. 

= {3«i + 2a 2 , 3«i + ot 2 , a 2 } . 

Therefore £ = {ai, 04 + a 2 , 2ct\ + a 2 } . The Weyl group Wk is the symmetry group of the 
regular hexagon Dq =< cr, r|cr 6 = 1, r 2 = 1 > with the following operations on ai, 02: 

a : ai^ —ai — a 2 , a 2 t— > 3«i + 2^2, 
r : ati 1— > — Qfi — «2, «2 h_ > «2- 

Suppose p is a class one representation with the highest weight p = a\W\ + 02^2 = 
(2ai + 3*22)04 + (ai + 202)02, where a±, a 2 are two nonnegative integers. A computation using 
Kostant Branching Theorem shows that a 2 = and the multiplicity [Resp : Id] is 1. □ 

A. 4. Properties of Class One Representations. First we consider the types and non- 
trivial kernels of class one representations. They follow easily from Proposition 23.13 and 
propositions in §26.3 in [FHJ. 

Proposition A. 19. The type and non-trivial kernel Z of each complex class one represen- 
tation is listed in Tabled 

In Table El for K = U(n)(a = b) and K = Sp(n) x U(l)(k = 0), the Z factor in the 
non-trivial kernel should be interpreted as the group {7(1) = {z ■ ld\z G {7(1)}. Furthermore, 
Z 2 C K is generated by —Id and C SU{n)(pi U{n)) is generated by tpi ■ Id with tpi = 
exp(^— !-). The notation gcd(p, q) stands for the greatest common divisor of p, q. 

Next we give the dimensions of the class one representations, see [FHJ. 

Proposition A. 20. The dimension of each complex class one representation for the pair 
(K, H) is listed as follows: 

• (SO(n), SO(n - 1)) : p = aw x , 

dimp= 2o±n^/a+n-2N 
" a+n—2 \ a I 
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K 


p 


Type 


Z 


SO{n) 




real 


Z 2 : if both n and a are even 


SU(n) 


azu-i + bzu„—i 

_L 1 It _L 


real: if a = b 
complex: otherwise 


Z/, I = ercdfa + 6, n) 


U(n) 


aei - be n + 
m(a — b)(ei H h e n ) 


real: if a = b 
complex: otherwise 


^|(a-b)(l+mn)| •' if a ^ b 


Sp(n) 


aw\ + 6tz7 2 


real: a is even 
quaternionic: otherwise 


Z 2 : if a is even 


Sp(n) x Sp(l) 


(arox + bw 2 ) <S> azui 


real 


Z 2 x Z 2 .' i/a^O even 
Z 2 x Sp(l): i/a = 


Sp(n) x U(l) 


(azui + bw 2 ) <S> (fi k 


complex: k 7^ 

real: k = and a is even 

quaternionic: otherwise 


Id x Z|fc| : z/ a is odd 
Z 2 x Z|fe|.- if a is even 


G 2 


aw\ 


real 




Spin{7) 


azu% 


real 


Z 2 : i/a is even 


Spin(9) 


aw\ + bvjA, 


real 


Z 2 : i/6 zs even 


U(l) 


cj) k 


complex 


Z\ k \: if \k\ > 1 



Table 2. Type and non-trivial kernel of class one representations 



• (SU(n), SU(n — 1)) : p = aroi + bw n -\, 

dimp= a±ki^l(«+™-2)(f>+n-2j 

• (U(n),U(n - l) m ) : p = aei - 6e n + m(a - 6)(ei H h e n ), 

dimp=^-rr 2 )rr 2 ) 

• (Sp(n), Sp{n — 1)) : p = aw\ + &w 2; 

,. _ (a+l)(a+2b+2n-l) /a+b+2n-l\ /b+2n-3\ 

tUm f' _ (a+Hl)(o+!H-2n-l) I a+b A b J 

• [Sp[n) x Sp(l), Sp(n — 1) x Sp(l)) : p = [avo\ + bzu 2 ) <g> aw\, 

j. _ (a+l) 2 (a+2b+2n-l) /a+b+2n-l\ /b+2n-3\ 

Ulm ^ (a+b+l)(a+b+2n-l) ^ a+b A b J 

• (Sp(n) x 1/(1), Sp(n - 1) x U(l) m ) : p = (aw 1 + bw 2 ) <g> 

,. _ (a+l)(a+2b+2n-l) /a+b+2n-l\ /b+2n-3\ 

alm P ~ (a+b+l)(a+b+2n-l) \ a+b A b J 
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• (G 2 , SU (3)) : p = aw\, 

dimp = -L(a + I) (a + 2) (a + 3) (a + 4) (2a + 5) 

• (Spin(7),G 2 ) : p = aw 3 , 

dimp = ^(a + l)(a + 2) (a + 3) 2 (a + 4) (a + 5) 

• (Spin{9), Spin(7)): p = aw\ + bm±, 

dimp = T g T ^(a + l)(a + 2) (a + 3) (6 + 1)(6 + 2)(6 + 3) 2 (6 + 4) (6 + 5)(a + b + 4) (a + 
6 + 5)(a + 6 + 6)(2a + 6 + 7) 

• (C/(1),{1}): p = fc , dimp=l. 

Finally for each spherical pair (K,H), we consider the embedding p : .K" — ► SO(l), U{1) 
and Sp(l). We compare the dimension of the sphere K/H and L 

Proposition A. 21. Tabled is the list of the dimension s of the sphere K/H and the em- 
bedding p : K — > SO (I) with I < ko(s + 1) where k is equal to 1, 2 or 4 if p is of real, 
complex or quaternionic type. 

For the complex representations, we have 

Proposition A. 22. Tafr/e[7] is the list of the dimension s of the sphere K/H and the em- 
bedding p : K — > U (I) with 21 < s + 1. 

A similar result for the quaternionic representations is 

Proposition A. 23. The quaternionic class one representations p : K — > Sp(l) with 41 < 
dim(K / H) + 1 are exactly the representation p = w\ for the pair (Sp(n), Sp(n — l))(n > 1). 
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12 
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12 


Sp(2) 


Sp(l) 
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32 


8 


32 


Sp(l) 
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Table 3. Orthogonal Class One Representation with Small Dimension 
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Table 4. Complex Class One Representation with Small Dimension 
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